Automated Essay Scoring: A Literature Review

In recent decades, large-scale English language proficiency testing and testing research have seen an increased interest in constructed-response essay-writing items (Aschbacher, 1991; Powers, Burstein, Chodorow, Fowles, & Kukich, 2001; Weigle, 2002). The TOEFL iBT, for example, includes two constructed-response writing tasks, one of which is an integrative task requiring the test-taker to write in response to information delivered both aurally and in written form (Educational Testing Service, n.d.). Similarly, the IELTS academic test requires test-takers to write in response to a question that relates to a chart or graph that the test-taker must read and interpret (International English Language Testing System, n.d.). Theoretical justification for the use of such integrative, constructed-response tasks (i.e., tasks which require the test-taker to draw upon information received through several modalities in support of a communicative function) date back to at least the early 1960’s. Carroll (1961, 1972) argued that tests which measure linguistic knowledge alone fail to predict the knowledge and abilities that score users are most likely to be interested in, i.e., prediction of actual use of language knowledge for communicative purposes in specific contexts

Diagnostic Second Language Assessment in the Classroom

The term diagnosis is familiar, and refers to the identification of disease or disorder in an individual. In the broadest sense, then, diagnostic second language (L2) assessment refers to any L2 assessment practice, whether in the form of a formal written test or informal teacher questioning, that yields diagnostic feedback—information on learner strengths and weaknesses. In low-stakes classroom contexts, where psychometric rigor is sacrificed for the attention and rich intuitions of teachers, informal diagnostic assessment occurs on a regular basis in the form of student questioning, explanation, and the provision of written feedback on quizzes, tests, and written work. Indeed, Huff and Goodman (2007) showed that K-12 science and language arts teachers highly value diagnostic feedback and prefer assessments which yield detailed information that can be used to identify the instructional needs of individual learners. Despite this apparent interest on the part of teachers in the diagnostic function of assessment, Alderson (2005, 2007) points out that diagnostic testing has been largely neglected in the L2 literature. Fundamental questions regarding the proper domain and application of diagnostic testing are unresolved: Must a diagnostic L2 test measure proficiency and be based on a theoretical model of L2 ability, or can diagnostic assessment be equally applied to achievement in a curriculum? Where does the boundary between formative assessment and diagnostic assessment lie? What kinds of feedback, and at what level of detail, are most beneficial to L2 learners

Technological Growth and L2 Construct Definition: Will Applied Linguistics Keep Pace with Language Users?

Chapelle (2003) coined the phrase “tunnel of efficiency” to describe what she considers a truncation of vision on the part of applied linguists who have studied technological innovations in L2 assessment. This nearsightedness, she argues, has led to an overemphasis of research that serves immediate practical considerations, i.e., faster, more efficient delivery and scoring of traditional tests. Underemphasized is the question of how the rapidly advancing availability and widespread use of new technology can or should change L2 constructs. To maintain the relevance of our field and coherently evaluate the validity of L2 assessment use arguments, we must pay attention to these questions

Technological Growth and L2 Construct Definition: Will Applied Linguistics Keep Pace with Language Users?

Chapelle (2003) coined the phrase “tunnel of efficiency” to describe what she considers a truncation of vision on the part of applied linguists who have studied technological innovations in L2 assessment. This nearsightedness, she argues, has led to an overemphasis of research that serves immediate practical considerations, i.e., faster, more efficient delivery and scoring of traditional tests. Underemphasized is the question of how the rapidly advancing availability and widespread use of new technology can or should change L2 constructs. To maintain the relevance of our field and coherently evaluate the validity of L2 assessment use arguments, we must pay attention to these questions

Automated Essay Scoring: A Literature Review

In recent decades, large-scale English language proficiency testing and testing research have seen an increased interest in constructed-response essay-writing items (Aschbacher, 1991; Powers, Burstein, Chodorow, Fowles, & Kukich, 2001; Weigle, 2002). The TOEFL iBT, for example, includes two constructed-response writing tasks, one of which is an integrative task requiring the test-taker to write in response to information delivered both aurally and in written form (Educational Testing Service, n.d.). Similarly, the IELTS academic test requires test-takers to write in response to a question that relates to a chart or graph that the test-taker must read and interpret (International English Language Testing System, n.d.). Theoretical justification for the use of such integrative, constructed-response tasks (i.e., tasks which require the test-taker to draw upon information received through several modalities in support of a communicative function) date back to at least the early 1960’s. Carroll (1961, 1972) argued that tests which measure linguistic knowledge alone fail to predict the knowledge and abilities that score users are most likely to be interested in, i.e., prediction of actual use of language knowledge for communicative purposes in specific contexts

Diagnostic Second Language Assessment in the Classroom

The term diagnosis is familiar, and refers to the identification of disease or disorder in an individual. In the broadest sense, then, diagnostic second language (L2) assessment refers to any L2 assessment practice, whether in the form of a formal written test or informal teacher questioning, that yields diagnostic feedback—information on learner strengths and weaknesses. In low-stakes classroom contexts, where psychometric rigor is sacrificed for the attention and rich intuitions of teachers, informal diagnostic assessment occurs on a regular basis in the form of student questioning, explanation, and the provision of written feedback on quizzes, tests, and written work. Indeed, Huff and Goodman (2007) showed that K-12 science and language arts teachers highly value diagnostic feedback and prefer assessments which yield detailed information that can be used to identify the instructional needs of individual learners. Despite this apparent interest on the part of teachers in the diagnostic function of assessment, Alderson (2005, 2007) points out that diagnostic testing has been largely neglected in the L2 literature. Fundamental questions regarding the proper domain and application of diagnostic testing are unresolved: Must a diagnostic L2 test measure proficiency and be based on a theoretical model of L2 ability, or can diagnostic assessment be equally applied to achievement in a curriculum? Where does the boundary between formative assessment and diagnostic assessment lie? What kinds of feedback, and at what level of detail, are most beneficial to L2 learners

Fermi-dirac and random carrier distributions in quantum dot lasers

Using experimental gain and emission measurements as functions of temperature, a method is described to characterise the carrier distribution of radiative states in a quantum dot (QD) laser structure in terms of a temperature. This method is independent of the form of the inhomogeneous dot distribution. A thermal distribution at the lattice temperature is found between 200 and 300K. Below 200K the characteristic temperature exceeds the lattice temperature and the distribution becomes random below about 60 K. This enables the temperature range for which Fermi-Dirac statistics are applicable in QD laser threshold calculations to be identified. (C) 2014 AIP Publishing LLC

Do face masks introduce bias in speech technologies? The case of automated scoring of speaking proficiency

The COVID-19 pandemic has led to a dramatic increase in the use of face masks worldwide. Face coverings can affect both acoustic properties of the signal as well as speech patterns and have unintended effects if the person wearing the mask attempts to use speech processing technologies. In this paper we explore the impact of wearing face masks on the automated assessment of English language proficiency. We use a dataset from a large-scale speaking test for which test-takers were required to wear face masks during the test administration, and we compare it to a matched control sample of test-takers who took the same test before the mask requirements were put in place. We find that the two samples differ across a range of acoustic measures and also show a small but significant difference in speech patterns. However, these differences do not lead to differences in human or automated scores of English language proficiency. Several measures of bias showed no differences in scores between the two groups

Housing First Feasibility Study for the Liverpool City Region : Final Report

This study was commissioned by Crisis, with funding from the (UK Government) Department for Communities and Local Government and the Housing First Europe Hub. It was conducted by a consortium led by Imogen Blood & Associates and including Housing & Support Partnership, HGO Consultancy, and the Centre for Housing Policy (University of York). The study aimed to test the feasibility of implementing Housing First at scale within the Liverpool City Region (LCR) by using a wide range of quantitative and qualitative data from LCR to develop, evaluate and propose a model for implementing Housing First at scale within the region; assessing the financial and commissioning implications of making the transition to this model; and, understanding the local and national policy changes needed to support this model

Femtosecond pulse generation in passively mode locked InAs quantum dot lasers

Optical pulse durations of an InAs two-section passively mode-locked quantum dot laser with a proton bombarded absorber section reduce from 8.4 ps at 250K to 290 fs at 20 K, a factor of 29, with a corresponding increase in optical bandwidth. Rate equation analysis of gain and emission spectra using rate equations suggests this is due to the very low emission rate of carriers to the wetting layer in the low temperature, random population regime which enables dots across the whole inhomogeneous distribution to act as independent oscillators. (C) 2013 AIP Publishing LLC